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ABSTRACT 



This report describes a decision-making tool designed to 
inform special educators of the most up-to-date participation and test 
accommodations guidelines and to assist educators in the process of making 
informed decisions. It reports on the results of a study that examined the 
tool’s feasibility and practicality. The decision-making tool is an 
electronic version of Minnesota guidelines for making test participation 
decisions. The Web site design has two branches, one for students with 
disabilities and another for students with limited English proficiency (LEP) ; 
both are centered on making decisions about inclusion and the use of testing 
accommodations. The Web site design has two branches of decision making to 
reflect the dual role of the tests within both the LEP and disability 
branches- -one for statewide accountability testing for grades three, five, 
and eight, and one for graduation requirements testing for grades eight and 
beyond. A survey of 8 special educators, 5 parents, 1 administrator, and 1 
school psychologist found that 10 thought the format of the tool was easy to 
understand, 8 would use the tool again, and 11 would recommend the tool to 
others. Appendices include an overview of the decision matrix and the survey. 
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Overview a 

Large-scale assessments, and in particular high stakes graduation tests, are becoming common 
throughout the United States. The 1997 reauthorization of the federal Individuals with Disabilities 
Education Act (IDEA) sets the expectation that nearly all students with disabilities will participate 
in large-scale assessments for the purpose of measuring students’ progress toward state standards 
beginning in 1998. It also supports the development of appropriate test adaptations for students 
with disabilities. In addition, states must report the number of students with disabilities 
participating in the assessments and the performance achieved by the students. 

In Minnesota, statewide accountability testing currently takes place in grades three, five, and 
eight. The tests given at grades three and five are called Minnesota Comprehensive Assessments 
(MCAs) and cover the areas of reading, mathematics, and writing. The MCAs are given solely 
as a measure of system accountability. The eighth grade tests are called Basic Standards Tests 
(BSTs) and have a dual role. Like the MCAs, they are used for systemic accountability, but they 
are also used as minimum standards that students must pass in order to be eligible for a high 
school diploma. The BSTs are made up of tests of reading and mathematics administered 
beginning in eighth grade and a writing test administered in 10th grade. 

In order to continue to receive federal special education funds, states are required to include all 
students with disabilities in their regular assessments, with accommodations as needed. An 
important part of planning for appropriate participation and accommodations for students with 
disabilities is having a set of stable testing guidelines that educators can refer to so that decisions 
are made on a consistent basis across students, schools, and districts. By 1997, most states had 
developed assessments and guidelines for use in planning accommodations for students with 
disabilities. Minnesota has written guidelines for the use of accommodations for the Minnesota 
Basic Standards Tests (BSTs) and for the Minnesota Comprehensive Assessments (MCAs). 
Both sets of guidelines, which are distributed to schools, have been available primarily in paper 
format. 

Despite the historical practice of pervasive exclusion of students with disabilities from assessment 
and accountability systems across the United State, there are states that have made significant 
efforts to include all students and to report the performance of students with disabilities in 
statewide tests (Thurlow, Langenfeld, Nelson, Shin & Coleman, 1998). School districts across 
Minnesota have been including nearly 90% of eighth graders with disabilities in the BSTs 
(Thompson, Thurlow, Spicuzza, & Parsons, 1999) and Minnesota’s participation rates for students 
receiving special education services in the statewide MCAs are among the highest in the United 
States (Thompson et al., 1999). 

As in other states, Minnesota’s written guidelines have been distributed to schools across the 
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state. Guidelines also can be found on the Department of Children, Families, and Learning Web 
site. By themselves, however, written guidelines in standard text format have not been sufficient 
to help students with disabilities, who along with their parents, teachers, and administrators, 
make informed decisions about whether they should participate in testing and what 
accommodations should be used. 

Informal discussions with educators have revealed that they did not believe that they had received 
enough information to make informed test participation decisions for students with disabilities. 
Furthermore, many educators indicated that they found the paper format difficult to understand 
when applying guidelines to complex decisions. Educators expressed frustration in not knowing 
who should make participation decisions, and were unfamiliar with the test accommodations 
and modifications available to students with lEPs or 504 plans (Spicuzza, Erickson, Thurlow, 
& Hurley, 1996; Spicuzza, Thurlow, Erickson, & Ruhland, 1997; Ysseldyke, Thurlow, McGrew, 
& Shriner, 1994; Ysseldyke, Thurlow, McGrew, & Vanderwood, 1994). This type of frustration 
may be increased as guidelines are revised and updated for each test cycle; educators become 
uncertain about which version is current. 

With this frustration in mind, Minnesota Assessment Project researchers designed a decision 
making tool to inform special educators of the most up-to-date participation and test 
accommodation guidelines and to assist school staff in the process of making informed decisions 
with students and their families (Spicuzza, Erickson, Thurlow, & Hurley, 1996). To make the 
tool interactive and widely available, it was designed to be used on-line or on a computer disk. 
This report describes the decision making tool and reports on the results of a study that examined 
the tool’s feasibility and practicality. 



Creation of a Decision Making Tool 

To create a tool that would be helpful for making decisions about participation in assessments 
and accommodations, it was decided that the presentation of the written guidelines needed to be 
simplified. This was accomplished by designing a presentation format that divided the assessment 
guidelines into smaller portions of text. 

There are two reasons to simplify the presentation of the guidelines. First, the new presentation 
format enables someone who is not an expert in assessment to use the decision making process 
for planning. Second, sequenced guidelines can help parents, teachers, administrators, and student 
work together to make the best participation decision for the student. 

Other issues related to using a paper format for the assessment guidelines surface with teachers 
when discussing accommodation decisions for statewide testing. During the implementation of 
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this new accountability system, the Minnesota graduation standards have caused many memos 
and information reports to be generated and a specific guidehne easily gets lost or misplaced 
before the administrator or teacher receiving the information can plan how to use the news. 
Therefore, the assessment guidelines are not available or ready to use when needed by the 
planning team. Also, it is difficult to keep documents current and assure that everyone on the 
decision making team has the same information. 

In order to reduce these difficulties and make the decision making process more efficient, a 
decision making tool was designed that could be accessed on the World Wide Web. The guidehnes 
and a decision matrix (see Appendix A) were integrated into the Web-based tool. This tool was 
created in a Web-based format because the complexities of test decision making can be presented 
in an understandable and manageable manner. The Web uses a combination of graphics and text 
that divide the decision matrix into a series of questions for consideration during a planning 
discussion. 

A format was needed that would be easily accessible to all people who might be making testing 
decisions. This includes teachers, administrators, parents, students, and other lEP team members. 
While the availability of computer technology and access to the World Wide Web varies greatly 
from district to district, and even from building to building and home to home, most schools 
and families have some access to the Web or will in the near future. A paper format of guidehnes 
will always be needed; however, the Web-based version of the guidehnes has several advantages. 
With the Internet, decision making tools such as this can be available to everyone in the state 
and changes in the process can be made instantly since everyone is accessing the same copy. 
Using the Internet also aUows teachers and parents to have access from home or other community 
sites. 

It should also be noted that one does not have to be connected to the World Wide Web in order 
to use the decision making tool; access to a Web browser (such as Netscape or Microsoft Explorer) 
is all that is needed. If one has a Web browser, but is not connected to the Web, the decision 
making tool can be run from a diskette. This format does not allow the copy to be instantly 
updated, but it does give educators and parents access to the decision making matrix. 

Finally, the Web tool was designed to be simple in terms of graphics and other features. This 
allows for quick access, making it easy to maneuver through the site. The design is also 
straightforward. Since educational teams are often making decisions with students, the decision 
matrix is short and simple. It was designed so that people with varying technological backgrounds 
can become famihar with the tool very quickly. 
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The Decision Making Tool 



The decision making tool used in this study is an electronic version of Minnesota guidelines for 
making test participation decisions and a decision matrix (see Appendix A). The address for the 
decision making tool is http://www.coled.umn.edu/ NCRO/M API (see Appendix B) The Web 
site design has two branches, one for students with disabilities and another for students with 
limited English proficiency; both are centered on making decisions about inclusion and the use 
of accommodations in statewide testing. For each of these parallel branches users choose which 
type of test is being planned for: (1) Minnesota Comprehensive Assessment (statewide 
accountability testing) or (2) Basic Standards Tests (basic graduation requirement test). The 
homepage for the decision making tool ends with this statement and decision. 

This web site was designed to help parents and educators make decisions about student 
participation in different forms of statewide testing. Follow the links below to a decision 
matrix for Limited English Proficient (LEP) students or students with lEP or 504 plans. 

The Web site design has two branches of decision making to reflect the dual role of the tests 
within both the LEP and IEP/504 plan branches — one for statewide accountability testing for 
grades three, five, and eight, and one for graduation requirements testing for grades eight and 
beyond. The reason for having these two lines of decision making is that the decision may vary 
according to the reason a student is taking a test, either for statewide accountability or individual 
achievement for graduation. The second page for both the LEP and IEP/504 branches ends with 
the following statement and decision. 

Follow the links below to see if a student should participate in either form of testing and 
what kinds of accommodations are available for each test. 

Graduation Standards Statewide Accountability Testing 

As the user begins the decision making matrix, a question is posed about the student for whom 
the test participation decision is being made. The person using the decision matrix responds to 
this question by clicking on the appropriate answer, LEP or IEP/504. Then the second question 
asks about which type of test a decision is being made for. Next, the user is asked about student 
status to help determine whether the student should be included in the standardized test. If the 
student should be included, the user is given information about accommodations; if not, the 
user is given information about alternate forms of assessment. At any point in the process, the 
user can go back a step or to the beginning of the decision process. In the end, the user is 
provided with guidance on how a student could be included in the standardized test so that the 
student can best demonstrate knowledge within the state guidelines. 
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Decision Making Tool Flowchart 

The flow of questions for the Web-based decision making tool; guidelines for accommodations in 
testing is as follows: 
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To determine whether a computer-based decision making tool is useful for people involved in 
making decisions about the participation of students with disabilities in the Basic Standards 
Tests and Minnesota Comprehensive Assessments, a survey was developed for parents, educators, 
and administrators who participate in the decision making process. Survey response formats 
included closed response and open-ended response (see Appendix C). 

In December 1998 and January 1999, a total of 102 surveys were sent to 6 districts across the 
state of Minnesota. These districts were chosen from a larger set of districts that had previously 
agreed to work with CFL during the development and administration of the Basic Standards 
Tests. Some districts that had been recommended were not able to participate due to of a lack of 
computer resources needed to use the decision making tool. 

CFL classifies all districts in the state of Minnesota into one of four categories based on size 
and location. The categories are: 

• Cities of the First Class (large, urban school districts) 

• Suburban-Metro 

• Greater Minnesota > 2000 (rural districts with more than 2,000 students) 

• Greater Minnesota < 2000 (rural districts with fewer than 2,000 students) 

Four of the districts included in this study were in greater Minnesota with a population over 
2,000 students, and two districts were in suburban-metro areas. 
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A special education coordinator in each of the selected districts was sent the World Wide Web 
address of the decision making tool as well as a copy of the tool on a floppy disk, formatted for 
Macintosh or IBM PC-compatible computers, whichever was appropriate for the district. Thus, 
survey respondents had two ways to access the tool: through the Web site if they had Internet 
access, or from the disk if they had a Web browser but no Internet access. 

For each district, a special education coordinator received 16 surveys to distribute, plus one 
extra survey for making copies if needed. The special education coordinator was asked to 
distribute the surveys to educators and parents who were making decisions about the participation 
of students with disabilities in the Basic Standards Tests or Minnesota Comprehensive 
Assessments. After surveys were completed, the coordinator was asked to collect the surveys 
and send them to NCEO for analysis. 

Once surveys were returned, they were numbered and all quantitative responses were entered 
into a computer database for analysis. For the qualitative responses, one member of the research 
team used an inductive qualitative research technique to develop a coding system as described 
by Bogdan and Biklen ( 1 992). All of the qualitative data were reviewed holistically for regularities 
and themes. A system of coding categories based on the themes was developed and verified; all 
of the participants’ responses were clustered under these categories. 



Results 



Fifteen surveys (14.7%) were returned from three of the six districts (50%). The individual 
return rate of 14.7% was very low; however, extra surveys had been sent to each coordinator, 
who also had the option of distributing fewer surveys than were sent or copying the surveys and 
distributing more. In addition, a number of respondents used the tool to make decisions for 
more than one student before completing the survey. 

Respondents were primarily Special Education teachers and parents. One administrator and 
one school psychologist also completed the survey. Table 1 shows the breakdown of respondents 
by position. 

Availability and Familiarity of Computer Technology 

Of the six districts that were chosen to participate in the study, two (33%) were initially unable 
to do so because they lacked the computer technology needed to use the decision making tool. 
In both cases there was no computer available where the decision making process took place, or 
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Table 1. Positions Held by Survey Respondents 



Position 


Number of 
respondents 


Percent of 
Total 


Special Education teacher 


8 


53% 


Parent 


5 


33% 


Administrator 


1 


7% 


School Psychologist 


1 


7% 


Total 


15 


1 00% 



the computer that was available lacked the software necessary to run the decision making tool. 
One of these two districts was loaned a Macintosh laptop computer by the Minnesota Assessment 
Project in order to be able to use the tool and complete the survey. 

Nearly one-half of the respondents (47%) used the tool on a Macintosh computer, another 27% 
used the tool on a PC, and 20% did not specify what type of computer they used. One respondent 
(6%) reviewed the tool after participating in a meeting in which someone else used the tool to 
lead the discussion. 

Respondents were asked about their familiarity with computers in general, with the specific 
type of computer (Macintosh, PC) they used to look at the tool, and with the Internet. Table 2 
shows the number of respondents who indicated their level of familiarity with computers in 
general, the specific type of computer used for this study, and Internet use. Almost half of the 
respondents (47%, 7 of 15 responses) indicated they were very familiar with computers in 
general. Another 33% (5 of 15) were somewhat familiar with computers, two respondents (13%) 
were a little familiar with computers and one respondent (7%) was not at all familiar with 
computers before using the decision making tool. None of the parents among the respondents 
reported being very familiar with computers in general. Of the 15 respondents who used the 
tool on a computer, 33% were very familiar with the type of computer they used the tool on, 
27% were somewhat familiar, 33% were a little familiar, and 7% were not at all familiar with it. 
Of these same 15 respondents, 27% were very familiar with the Internet, 27% reported being 
somewhat familiar, 27% were a little famiUar, and 20% were not at all famiUar with the Internet. 

In general, 87% (13 of T5) respondents who used the decision making tool on a computer 
reported having the computer skills needed to use the tool. One respondent reported not having 
the required computer skills “for the 1st student, but the next two were better.” 

Overall, 80% of the respondents (12 of 15) reported that they have access to a computer at 
home. Of these respondents, 58% (7 of 12) indicated that they have Internet access at home. All 
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10 of the respondents who work in the school districts indicated that they have computer access 
at school and have Internet access there. Just over half (8 of 15, 53%) of the respondents have 
access to a computer where their lEP team meets, another 27% (4 of 1 5) do not have access, and 
the remaining 20% did not answer the question. 

Respondents were asked what Internet browser they have access to. The responses were almost 
evenly divided between Netscape Navigator (4 of 7, 57%) and Microsoft Explorer (3 of 7, 
43%). Of the 10 respondents who had Internet access at their schools, six (60%) have only 
Netscape Navigator, three (30%) have only Microsoft Explorer, and one (10%) has both. Of the 
six respondents who have Internet access where the Individualized Education Plan (lEP) team 
meets, two (33%) have Netscape Navigator, three (50%) have Microsoft Explorer, and one did 
not reply to this question. 

When asked whether their school keeps lEPs on computer, nine of the ten educators indicated 
that they did; 80% said all lEPs were on computer, 10% said some lEPs were on computer and 
one educator did not answer the question. 



Participation Decisions 

Respondents were asked who in their school district usually makes decisions about the 
participation of students with disabihties in Basic Standards Tests and Minnesota Comprehensive 
Assessments. Although there were six responses to choose from, only three responses were 
selected (see Table 3). Nine respondents (60%) indicated that the lEP team makes the decision 
(the special educators, one parent, and a psychologist); one respondent identified a special 
education teacher, a classroom teacher, and parents as decision makers. The second most common 
response after “lEP team” was “I don’t know” with 27% of responses (4 of 15) falhng in this 
category. The four respondents who gave this answer were all parents. One respondent (7%) 
indicated that a general education administrator usually makes participation decisions. 



Table 2. Respondents’ Familiarity with Computer Technology (N=15) 





General computer 
experience 


Experience with 
the computer 
used 


Internet 

experience 


Very Familiar 


7 


5 


3 


Somewhat Familiar 
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5 


A Little Familiar 
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5 
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Not at all Familiar 


1 


1 


3 
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Using the Decision Making Tool 



Slightly more than one-half of the respondents (8 of 15, 53%) used the decision making tool 
during an TF.P team meeting. Another 20% (3 of 15) used the tool before the lEP team meeting 
in which a decision was made, and 20% (3 of 15) used the tool after making a decision in an lEP 
team meeting. One respondent (7%) did not answer this question. 

Overall, ten respondents (67%) looked at the computer-based tool as part of a decision making 
group. Another four respondents (27%) looked at it alone, and one respondent used it both as 
part of a group and alone. 

Respondents in the school districts were asked how many students they used the tool to make 
participation decisions for. Responses to this question varied from 3 to 0 (one special educator 
reviewed the tool but did not use it to make a decision). Table 4 shows the breakdown of 
respondents by the number of students for whom they made decisions using the tool. 

Respondents were asked approximately how long it took for them to go through the tool for the 
first student and the last student for whom they used the tool. For the first student, the respondents’ 
answers ranged from two to twenty minutes while for the last student, they ranged from one to 
ten minutes (See Table 5). The average time to use the tool for the first student was 10.5 minutes, 
and the average for the last student was 5.4 minutes. Two of the respondents reported not using 
the tool to make decisions about student participation. Six respondents reported using the tool 
to make decisions for only one student (4 parents, psychologist, and administrator). The seven 
respondents who reported using the tool for more than one student were special educators. In all 
but two situations, the time needed to use the tool decreased by half or more from the first to the 
last use. 

Overall, 67% (10 of 15) of respondents thought the format of the computer-based tool was easy 
to understand. Another 27% (4 of 15) thought that it was not easy to understand (all parents); 



Table 3. Decision about Participation in the MCA and BST 



Decision Maker 


Number of 
Respondents 


Type of 
Respondents 






8 Special educators, 


lEP Team 


10 


1 Parent, & 






1 Psychologist 


1 don't know 


4 


Parents 


Administrator 


1 


Administrator 




13 



9 



Table 4. Number of Students for Whom the Decision Making Tooi was Used for Planning 



Students Planned 


Number of 
Respondents 


% of Respondents 


3 


3 


20% 


2 


4 


27% 


1 


7 


47% 


0 


1 


7% 



one of these respondents commented that they were “not familiar with Standards.” One 
respondent (7%) thought the format of the Web version of the tool was easy to understand, but 
was unable to understand how to use the disk version. Only one of the five parents who answered 
the survey thought the format of the tool was easy to understand. Respondents were also asked 
if the tool was easy to use. Amajority (10 of 15, 60%) thought it was easy to use. One respondent 
again had difficulty with the disk version of the tool but not the Web version. Again, only one 
parent thought it was easy to use. 

Respondents were asked whether they found the tool helpful in making decisions for a particular 
type of student. Eight of fifteen respondents (53%) thought it was helpful; they mentioned 
students with the following types of disabilities: learning disability, mild mental impairment, 
questionable ability, and students requiring modifications. One respondent (7%) did not think 
the tool was helpful, and the remaining six (40%) did not answer the question. Of the six who 
did not answer the questions, five were parents who said they could not answer for another 
parent about a student who was not their child. 

When asked whether they would use the tool again to make participation decisions for students 
with disabilities, 53% (8 of 15) respondents said that they would do so. Another 13% (2 of 15) 
said they would not use it again. The special educators comments were, “For one student it 
wasn’t necessary and wasted time. It was good when I did it ahead of the meeting,” “waste of 
time-easier to do with paper flow charts,” and from a parent, “should be a teacher, not parent 
decision.” An additional 27% (4 of 15) were not sure whether they would use it again. One said, 
“Some lEP teams are in too much of a hurry to wait for this,” while a parent said that further 
usage of the tool would be someone else’s decision. 

Eleven respondents (73%) said they would recommend the tool to others who are involved in 
participation decisions. Three respondents (20%) were unsure whether they would recommend 
it (all parents). Another 7% (1 of 15) would not recommend the tool because the process is 
easier to do with paper flow charts.” Respondents were asked when in the decision making 
process they thought the tool would be most helpful. Eight of fifteen (53%) thought it would be 
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Table 5. Time Needed to Use the Tool 



Minutes for First 
Student’s Plan 


Minutes for Last 
Student’s plan 


No. Of 

Respondents 


No response 


No response 


2 


2 


No response 


1 


3 


1 


1 


5 


2 


1 


5 


3 


1 


5 


10 


1 


10 


7 


1 


10 


No response 


1 


12 


No response 


1 


15 


5 


1 


15 


No response 


2 


20 


10 


1 


20 


No response 


1 


10.5 avg. 


5.4 avg. 





Note. Seven respondents reported using the decision making tool on more than one student. 



helpful as preparation for ah lEP team meeting, two (13%) thought it would also be helpful 
during the meeting, and 5 of 15 (33%) did not know. Of the five who did not know whether the 
tool would be helpful for an lEP meeting, four were parents. 



Qualitative Results 

In addition to the quantitative results discussed so far, there were a number of comments written 
in answer to open-ended questions and voluntarily written on the surveys. A list of the comments 
was compiled and separated into the following topic categories: 

1. Clarity of information in the tool 

2. Usefulness of the tool 

3. Mode in which information is presented 

4. Amount of information in the tool 

5. Technology issues 

6. Clarity of the survey 

7. Miscellaneous 
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Major themes of each category are discussed below. (For a complete list of comments, see 
Appendix D.) 

Clarity of information in the tool. The comments in this category fell into two major 
groups. Special education professionals said that the information was “simple and clear” 
and very useful and thorough.” In general, their reactions were positive. On the other hand, 
parents of special education students made comments that the information “should be written 
much more clearly and not in educational jargon,” and it should be “easier to understand.” It 
seems that none of the five parents had a positive reaction to using the tool. 

• Usefulness of the tool. Respondents thought that the tool was useful for some, but not all, 
types of students. One commented, “For some students a simple discussion is enough and 
this is not necessary,” while another said it was useful for students of questionable ability. A 
respondent also pointed out that “some lEP teams are in too much of a hurry to wait for this.” 
The usefulness of the tool is also related to the mode in which information is presented to 
decision-makers, the topic category that will be discussed next. 

Mode in which information is presented. The major theme in this category is that many 
people, particularly parents of students with disabilities, would like to have information on 
paper. One comment sums up the situation very well: “We used the tool during our meetings. 
Perhaps if we had gone through the process before the meeting and printed out the results, or 
if we provided a companion written piece for parents, it would have worked better.” 

Amount of information in the tool. Some respondents wanted to see more information 
about modifications to Basic Standards Tests in the tool. 

• Technology issues. Respondents in one school district found the Web site easy to understand 
but were unable to use the disk version of the tool. Other respondents pointed out that in 
large lEP team meetings not everyone could see the computer screen. 

Clarity of the survey. Some respondents were confused by the fact that the tool refers to 
Basic Standards Testing and Statewide Accountability Testing while the survey used both 
those terms and the acronyms BST and MCA. 

Miscellaneous. Comments in this category included one person wondering whether the 
participation of students with disabilities in Basic Standards Tests and Minnesota 
Comprehensive Assessments would be required in the future. Another was a statement from 
a parent that such participation should be a teacher’s, not a parent’s decision. 



12 




NCEO 

16 



Discussion 



The purpose of this study was twofold: (1) to create a tool that presented the CFL guidelines for 
making decisions about participation of students with disabilities in the statewide testing, and 
(2) to determine the usefulness of this tool for decision makers (e.g., teachers, parents, 
administrators, students). In order to make the decision making process efficient and accessible, 
a decision making tool was designed using the World Wide Web. 

Six school districts agreed to participate in a field test of the tool and provide feedback through 
a user survey. Four of the districts were greater Minnesota schools with student populations 
over 2000 and two of the districts were in suburban metro locations. The data from these districts 
support several general conclusions. 

The technology available at the state department exceeds that available in many districts. 

Half of the districts responded by returning surveys. A third of the districts did not have access 
to compatible hardware or software, even though CFL had the technology and assumed that the 
school districts also had it. We assume that the six districts in the study are similar to all districts 
in Minnesota. Therefore, our findings suggest that tools created for the school districts at large 
must intentionally Umit the technology used. Technology use should be restricted to software 
that can be available through the Internet for computers with limited capacity and also available 
through a floppy disk. The respondents reported they had sufficient user experience to execute 
the decision making tool. 

Special educators are the primary audience for the decision making tool. About half of the 
respondents were special education teachers (8 of 15), and parents were surveyed in only one 
school. This may have been because of the method for recruiting within district participants, 
which was to find them through special education coordinators. It is unclear from this report 
whether parent representation in this study is typical of the lack of parental involvement in lEP 
decisions (Friedson, 1990; Goldstein, Strickland, Turnbull & Curry, 1980) or the result of the 
method of recruitment for this study. 

Although most respondents reported that a team made the participation decision, it is unclear 
from this survey who should be team members. It is noted here that an lEP team appropriately 
includes parents, classroom teachers, special education teacher, administrator, and student when 
appropriate (U.S. Department of Education, 1997). No surveys were submitted from classroom 
teachers. Since most students with disabiUties are included in general classes it is important to 
systematically include the general education teachers in the development of the lEP (Gilliam & 
Coleman, 1981, Nevin, Semmel, & McCann, 1983). Although the audience for the decision 
making tool varies for each district, a special educator is always involved. Therefore, it is 
reasonable to conclude that the special educator is a primary audience for this tool. 
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The decision making tool is efficient. Special educators reported that the decision making tool 
was simple, clear and easy to use. These are indicators that the specific tool is efficient. It 
appears the decision making tool was helpful in presenting the critical questions for participation 
and test accommodation. This would seem logical since the tool was designed to include the 
CFL guidelines for determining level of participation and accommodations to use for students 
with disabihties. This indicates that the tool successfully communicates the CFL guidelines in 
a user-friendly manner. After the initial investigation of the decision making tool, respondents 
reported that averages of 5 minutes were needed to use the tool for a student, another indicator 
that the tool is efficient. 

Parents are confused by the decision making tool. One third of the respondents were parents 
of children with disabilities. Generally the parents reported that the tool was confusing. They 
indicated that a paper copy to take with them would have been more appealing. Parents also 
reported not having access to computers as frequently as the professionals, and they reported 
not hking the use of “jargon,” apparently the titles and initials used to identify the state tests, the 
BSTs and MCAs. Most professionals, who reported using the computer as a function of their 
job, seemed to be familiar with the testing titles and generally are involved in making decisions 
about test participation for many students. In contrast, parents, who have different experience 
with the computer, are involved in making the test participation decision for their child only, 
and experience the state-wide testing information for the first time as their child enters the 
process. 



Parents seem to be confused and frustrated by the process of testing and decision making about 
testing, and the tool added to that confusion rather than diminishing frustration. It is possible 
that parents confusion about the decision making tool was confounded by other factors. It 
appears that, overall, the tool was not helpful for parents involved in test participation decisions. 
Several studies have found that there is limited involvement of parents in the lEP process (Gartner 
& Lipsky, 1992, McLaughlin & Warren, 1995; Singer & Butler, 1992). Parents who are attending 
lEP meetings need tools that will promote an assurance of appropriate education for their child, 
but not tools that result in confusion. Some knowledge of statewide testing is assumed of the 
audience that would use the decision making tool as it now stands. This tool will need revision 
for parents to benefit from its use in decision making. 



Useful but not regularly used. It may be that the decision making tool is most suited to training 
special educators to lead the discussion about test participation. It seems to have clarified the 
critical questions and communicated the options needed in decision making. Two comments 
stated what might be true of most lEP teams, “Some lEP teams are in too much of a hurry to 
wait for this,” and “For some students, a simple discussion is enough and this is not necessary.” 
Therefore, although the decision making tool is current and efficient, it may not be useful to an 
lEP team on a regular basis. It seems that it would be useful in training and to help special 
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educators prepare information for discussion at the team meeting, but few teams would 
incorporate its use into their team meetings. 

In summary, when testing accommodations are made available so that as many students as 
possible can meaningfully participate in an assessment, it is important to have efficient and 
accessible guidelines available for the people making accommodation decisions. These people 
may include administrators, teachers, counselors, parents and students. When testing decisions 
are being made on an individual basis, guidelines for making these decisions need to be clear so 
that decisions are made fairly and accommodations are used to help make the tests more accessible 
to the student. When students receive the accommodations they need, the validity of the test 
results increases. 

At the present time, most states do not have a decision making process in place that will walk 
people through this often-complicated process. The decision making tool designed for educators 
in Minnesota and available through the Internet is an attempt at helping streamline this process. 
Although the tool contains language that some people find confusing, and the tool may not be 
accessible to some due to technological availability, it does offer many benefits. Most special 
education professionals found it to be a clear and useful resource. As technology increases in 
schools and homes around the state, this tool should become more accessible. The decision 
maki ng tool is efficient, taking a brief amount of time, and thorough. Using the information 
gained through the survey data contained in this report, the decision making tool can be improved 
so that it is even more useful to educators. 
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Appendix B 



Minnesota Assessment Project Decision Making Tool: 
Graduation Standards and Statewide Accountability Testing 
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The Minnesota Assessment Project 





The Minnesota Assessment Project is a four-year, federally funded effort awarded to the Minnesota Department of 
Children, Families and Learning from the U.S. Department of Education, Office of Educational Research and 
Improvement. 

The project's goal is to promote and evaluate the participation of students with limited English and students with 
disabilities in Minnesota's Graduation Standards. 

This web site was designed to help parents and educators make decisions about student participation in different 
forms of statewide testing. Follow the links below to a decision matrix for Limited English Proficient OLEP) students 
or students with lEP or 504 plans. 
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DecisioE-Makieg Matrix for Stadeets witli lEP or 5(D4 
Plans* GradaatioE Standards and Statewide Acconntalbility 

Testing 



What is Statewide Accountability Testing in Minnesota? 

The 1997 legislature mandated a system of Statewide Testing and Accountability (M.S. 121.1 113). Beginning in the 
1997-98 school year, all students enrolled in grades three, five and eight are to be tested with a single statewide test 
for the purpose of system accountability. 

The Minnesota Comprehensive Assessments wiU be used to test reading and mathematics at grade three and reading, 
mathematics and writing at grade five. The Basic Standards Tests in reading and mathematics will fulfill the testing 
requirements at grade eight. Testing at the high school level is not scheduled to begin until the 1999-2000 school 
year. 

How is Statewide Accountability Testing different from Basic Standards Testing? 

For Statewide Accountability Testing all students wiU take the same test. Additionally, there is no minimum score 
required for individual students. The results will be used for school and district accountability information. 

All students must pass the Basic Standards Tests to be eligible to receive a high school diploma. Districts may offer 
students many opportunities to meet the Basic Standards testing requirements in accordance with M.S. 
3501.0010-3501.0180. In addition, students with special needs may meet the standards at an individual level 
according to the requirements of their lEP or 504 plan. 



Test 


Basic Standards grade 8* 


MCA grades 3 and 5 Basic 
Standards grade 8 


Purpose 


Graduation requirement to be eligible for a 
high school diploma. 


System Accountability 


Results 


Individual Student Graduation Results: 

• Pass-State 

• Pass-Individual 

• Pass-Translation 


School and District Summary Information 
Individual Student Reports 


Test Administration 
Options Permitted 


• Accommodations 

• Modification to the standard 


• Accommodations 

— - =jj 



* The Basic Standards Test of Written Composition is given beginning in grade 10. The Basic Standards Tests of 
Readmg and Mathematics are given beginning in grade 8. 



Who must be included in Statewide Accountability Testing? 

^e progress of all students is important and should be measured to determine how best to teach and improve their 
learning. The law requires all students to be tested except for those very few students whose lEP or 504 teams 
determme they are incapable of taking the statewide test. 

If students with lEP or 504 plans are exempt from Graduation Standards Testing, are they also 
exempt from Statewide Accountability Testing? 

The exemption criteria are similar; a student may be exempted from a Basic Standards Test if the student's lEP or 
section 504 accommodation pl^ does not and never has included the requirements on which the tests are based. If a 
team deteimines that a student is not capable of reaching the state standard, a modified standard for graduation 
purposes may be created for the student. Modifications for Graduation Standards typically include either an 
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alternative interpretation of the passing score or the adrninistration of a more appropriate test based on the student s 
needs. 

For Statewide Accountability Testing, all students must take the test if they are capable of testing regardless of their 
anticipated score. There are no modifications allowed, however, the same testing accommodations permitted for 
Basic Standards testing will also be permitted for Statewide Accountability Testing. 

Testing Accommodations Permitted 



Test: 


Basic Standards 


Statewide Accountability Testing 


IEP/504 Students 


• Accommodations 

• Modification to the standard 


• Accommodations 



Follow the links below to make a decision about student participation in testing. 




Graduation Standards 




Statewide 



Accountability Testing 



Minnesota Assessment Project, 

MN Department of Children, Families and Learning 
and National Center on Educational Outcomes (NCEO). 
Web page design by Mike Anderson and Rick Spicuzza 
Direct comments or questions to andel819@tc.umn.edu 
http://www.coled.umn.edu/nceo/MAP 




best copy available 
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Computer-Based Decision Making Tool Survey 
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Decision Making Tool Survey 



Terms; BST = Basic Standards Tests (grade 8+) 

MCA = Minnesota Comprehensive Assessments (grades 3 & 5) 

Part I: Tell us about yourself 

1. Who are you? (Please check one.) 

a. parent 

b. student 

c. special education teacher 



2. Is your school district: (Please check one.) 

a. urban (e.g., Minneapolis, St. Paul, Duluth) 

b. suburban-metro (e.g., Bloomington, Eagan, Roseville) 

c. a greater Minnesota district with more than 2,000 students 

(e.g., Rochester, St. Cloud, Bemidji) 

d. a greater Minnesota district with fewer than 2,000 students 

(e.g.. Mountain Lake, Owatonna, Windom) 

3. How did you look at the decision-making tool? (Check one.) 

a. on computer; what kind? 

b. on paper 

c. I never looked at it (Another person used the tool.) 

4. How familiar were you with the following equipment before you used the decision-making 
tool? 



d. regular classroom teacher 

e. administrator 

f. other (please describe) 



a. A computer in general (circle one number choice) 

1. not at all familiar 

2. a little familiar 

3. somewhat familiar 

4. very familiar 
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b. The specific type of computer (IBM, Macintosh) you used to look at the tool (Circle one 
number choice.) 



1. not at all familiar 

2. a little familiar 

3. somewhat familiar 

4. very familiar 

5. 1 didn’t look at it on a computer 
c. The Internet (Circle one number choice.) 



1. not at all familiar 

2. a little familiar 

3. somewhat familiar 

4. very familiar 

5. 1 didn’t look at it on a computer 

5. Did you have the computer skills you needed to use the decision-making tool? (Check one.) 

a. Yes 

b. No; please explain 

I didn t look at it on a computer (Someone else used the tool.) 

6. Do you have access to a computer in the following places? (Check one answer for each 
letter.) 

a. at home 

yes If yes, do you have Internet access? a. yes 



b. at school 

1. yes 

2. no 



If yes, do you have Internet access? 



a. yes 

b. no 



c. where your lEP team meets 

1- yes If yes, do you have Internet access? 

2. no 



a. yes 

b. no 
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7. If you answered yes to any of the parts of question 6, which Internet browsers (e.g. Netscape 
Navigator, Microsoft Explorer) are available on this machine? 

a. (home) 

b. (school) 

c. (lEP team) 

d. I don’t have access to a computer 

8. Does your school keep Individualized Education Plans (lEPs) on computer? (Check one.) 

a. yes; how many? 1. alllEPs 

2. somelEPs 

b. no 

c. I don’t know 

Part 2: Tell Us About the Decision-Making Tool 

9. In your school or district, who usually makes decisions about the participation of students 
with disabihties in the Basic Standards Tests or Minnesota Comprehensive Assessments? (Check 
one.) 

a. a special education administrator 

b. a general education administrator 

c. a special education teacher 

d. a parent/parents of the special education student 

e. the lEP team 

f. other; please explain 
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10. When did you look at the tool? (Check all that apply.) 

a. before the lEP meeting at which we used the tool to help make decisions 

b- during the lEP meeting at which we used the tool to help make decisions 

after the lEP meeting at which we used the tool to help make decisions 

I never looked at the tool. (Someone else used the tool.) 

11. When you looked at the tool, were you: (Check one.) 

a. alone 

b. part of a group 

c- I never looked at the tool. (Someone else used the tool.) 

12. For how many students did you use the tool to help make BST and MCA participation 
decisions? (Check one.) 

three g. more than five 

b. one e. four 

c. two f. five 



13. How many minutes did it take for you to go through all the parts of the tool and make 
decisions for the first student for which you used it? (Fill in the blank with an approximate 
number of minutes, or fill in “NA” if you did not use the tool.) 

minutes to go through it for the first student 
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14. If you used the tool for more than 1 student, how many minutes did it take for you to go 
through all the parts of the tool for the last student for which you used it? (Fill in the blank with 
an approximate number of minutes, or fill in “NA” if you did not use the tool.) 
minutes to go through it for the last student 



15. Was the format of the tool easy to understand? (Check one.) 

a. yes 

b. no; why not? 

c. I never looked at the Decision-making tool. (Someone else used the tool.) 



16. Was the tool easy for you to use? 

a. yes 

b. no; why not? 

c. I never looked at the decision-making tool. (Someone else used the tool.) 



17. What additional information about participation in BST and MCA testing would you like to 
see included in this tool? (Write your answer below.) 

18. Was this tool more useful for making decisions about a particular type of student? (Check 
one.) 

yes; what type of student? 

no 
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19. In the future, would you use this tool again with the same student or with another student? 
(Check one.) 

yes 

no; why not? 

I’m not sure; why? 

20. Would you recommend this tool to others making these decisions? 

yes 

no; why not? 

I’m not sure; why? 

21. In your opinion, would this tool be most helpful: (Check one.) 

As preparation for an lEP team meeting 

During an lEP team meeting 

After an lEP team meeting 

I don’t know 



22. How can this tool be improved so that it is more useful to lEP teams making decisions 
about the participation of Special Education students in BSTs and MCAs? (Please write your 
thoughts below.) 
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do you still have about the participation of Special Education students 
(Please write your thoughts below.) 



23. What questions 
in the BST and MCAs? 
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Survey Comments from Survey Respondents 

Words in italics were added to make comments more clear. 

A “P” following a statement indicates a parent offered the comment. 



Clarity of information in tool 

It is pretty good the way it is. 

I thought it was very useful and thorough. I think it helped our team understand that there are 

steps involved in making 

decisions. 

Good information 

I thought it was simple and clear. It asks all the questions needed to make a clear objective 
decision especially when considering exempting. 

This tool was very helpful to learn more about grad, standards— especially accommodations. 
The other teachers at our school are now using the web address. We enjoyed it. Even our grad, 
standards technician was interested and mentioned this site for all of the teachers. 

More clearly explained. P 

Should be written much more clearly and not in educational jargon. P 
Easier to understand. P 



Usefulness of tool 



(Useful for) students with modification 
(Useful for) LD with modifications. 



(Useful for) LD. 



(Useful for) MMI. 
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(Useful for) when the decision is in doubt. 



For some students a simple discussion is enough and 
this is not necessary. 

(Useful for students with) questionable ability. 

Waste of time— easier to do with paper flow charts. 

For one student it wasn’t necessary and wasted time. It was good when I did it ahead of the 
meeting. 

Some lEP teams are in too much of a hurry to wait for this. 

I felt this gives a better understanding of how or what accommodation can/should be used. 
Easier to do with paper flow charts. 

Mode in which information is presented 

Helpful to have booklet available for parents to provide explanation. P 
Previous written information made available to parents. P 
Parent needs more time to read information beforehand. P 
Inservice for SPED 

Several parents requested a handout. Most of our parents don’t understand grad, standards at 
all. The parents don’t seem real happy to do the surveys. 

It would be more useful if it printed a form at the end listing the accommodations for the student 
and other information. 

We used the tool during our meetings. Perhaps if we had gone through the process before the 
meeting and printed out the results, or if we provided a companion written piece for parents, it 
would have worked better. 
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Amount of information in the tool 



Include some ideas for modifications on the BST in the software 
Technology issues (time, visibility) 

The lEP team seemed somewhat impatient about waiting for this process as part of the meeting. 
Our meetings are large and not everyone could see the screen. 

The Website (fonnat was easy to understand), not the disk — couldn’t understand how to use it. 
Disk didn’t work. 

Clarity of the survey 

I don’t know what this question refers to, the acronyms especially, (refers to BST and MCA) P 
What are BST & MCA’s? P 
What are these - BST and MCA? P 



Miscellaneous 

We just don’t know if they will ever be required in the future. So it’s hard to get excited about 
it. (response to question 23 about the participation of students with disabilities in the BSTs and 
MCAs) 

Should be a teacher, not parent decision. P 
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